Coordinated Home Energy Management for 
Real-Time Power Balancing 

Tsung-Hui Chang, Mahnoosh Alizadeh, and Anna Scaglione 

Department of Electrical and Computer Engineering 
University of California, Davis, 
One Shields Avenue, Davis, California 95616 
E-mail: tsunghui.chang@ieee.org, mahzadeh@ucdavis.edu, ascaghone@ucdavis.edu 



Abstract — This paper proposes a coordinated home energy 
' management system (HEMS) architecture where the distributed 
residential units cooperate with each other to achieve real-time 
power balancing. The economic benefits for the retailer and 
' incentives for the customers to participate in the proposed coordi- 
I nated HEMS program are given. We formulate the coordinated 
HEMS design problem as a dynamic programming (DP) and 
use approximate DP approaches to efficiently handle the design 
problem. A distributed implementation algorithm based on the 
I convex optimization based dual decomposition technique is also 
presented. Our focus in the current paper is on the deferrable 
appliances, such as Plug-in (Hybrid) Electric Vehicles (PHEV), 
in view of their higher impact on the grid stability. Simulation 
\ results shows that the proposed coordinated HEMS architecture 
can efficiently improve the real-time power balancing. 

I. Introduction 

i Even though Demand Response (DR) [1] technologies were 
studied and practiced since the 60s, their integration in the US 
wholesale markets has been facilitated by several regulatory 

■ rules and measures ever since the state of California was 
I struck by energy crises in 2000 and 2001. Available DR 

■ technologies are mainly categorized into the following: Direct 
] Load Control (DLC) strategies [2], [3], where a controller 
' centrally interrupts the jobs of participating appliances mostly 

in case of emergencies and to curtail high peak load; Dynamic 
Pricing programs [4], which includes several rates and tariffs to 
manage the demand for electricity in a decentralized manner, 
e.g.. Time of Use (TOU), Critical Peak Pricing (CPP), Real 
Time Pricing (RTP) and Day Ahead Pricing (DAP) rates; 
Demand bidding programs [5], where a market participant 
directly makes an offer to the wholesale market (or the retailer) 
for reducing electricity during peak times on the next day. 

All the above mentioned strategies have their own pros and 
cons. For example, DLC, probably the oldest and safest mea- 
sure of demand management, unfortunately cannot happen fre- 
quently, and thus they can offer little flexibility for integrating 
intermittent renewable resources into the grid. They are mainly 
designed for emergencies and cannot easily account for the 
inconvenience they cause to their customers, i.e., the Quality 
of Service (QoS) provided. TOU rates are designed months in 
advance and cannot handle real-time load management in case 
of emergencies or help integrate intermittent resources into the 
power grid. RTP may be the most practical and probably the 



cheapest way of managing electricity demand in the future but 
it faces the challenging problem of what these price signals 
should be to avoid causing physical and market instabilities 
while reflecting the true conditions of the market at the same 
time. In fact, it has been shown that RTP are likely to cause 
more volatility or even instabilities when customers respond 
to this new information and form a new feedback loop in the 
power system control model [6]-[8]. 

Given dynamic pricing tariffs, the responsibility of manag- 
ing demand in response to these price signals cannot be left to 
the consumer and should be mostly automated. Consequently, 
there is an extensive literature emerging on Home Energy 
Management Systems (HEMS), e.g., [9], [10]. In these works, 
researchers look into finding optimal designs for the software 
and hardware suited for residential use that would respond to 
these price signals in an automated fashion. These HEMS units 
receive requests from their owners specifying the appliances 
they plan to use in the near future and their preferences. The 
software then runs an optimization that plans the use of these 
appliances, based on their power consumption, job deadlines 
and other customer specified factors, taking into account the 
dynamic price made available to the unit from its associated 
retailer/aggregator 

As observed in [11], since all the residences are given the 
same dynamic price, current HEMS that individually operated 
by each residence will simultaneously schedule the load to 
the low-price period, and, consequently, a new "rebound" 
peak is created to the grid. In this paper, we aim to blur the 
boundaries between RTP and DLC strategies by proposing an 
architecture through which HEMS units inside the territory of 
an aggregator/ratailer can cooperate with each other to keep 
the demand presented by the retailer to the wholesale market 
balanced with the available generation supply (which might be 
the day-ahead bid plus locally available renewable resources). 
Several exiting works have considered such a coordinated 
energy management architecture, though different goals are 
considered. For example, in [11] a heuristic neighborhood- 
level energy management algorithm is proposed for scheduling 
the load of residential units such that the aggregate load meets 
a maximum power profile specified by the retailer In [12], a 
distributed energy management algorithm, based on a game- 
theoretic approach, was proposed to minimize the cost of the 



retailer as well as the peak-to-average ratio of the aggregate 
load. The work in [13] takes into account user dissatisfaction 
and proposed a distributed energy management algorithm that 
minimizes the cost of retailer and a cost that reflects the 
degree of user dissatisfaction. Both the works in [12] and [13] 
assumed that the operating times of appliances are known a 
priori, and, moreover, they allowed HEMS to optimize the 
load injection of appliances. However, in many cases, the 
appliances have fixed load profiles that cannot be altered. 
The operating times of appliances should also depend upon 
the householder's request which are usually random. Another 
issue that is not clearly addressed in the existing works is 
the incentives for the customers to participate in the energy 
management coordination. 

Our intention in this paper is to propose a coordinated 
HEMS architecture where the HEMS units in the residences 
collaborate to minimize the cost of the aggregator/retailer in 
the real-time market. Specifically, in addition to the cost for 
the day-ahead market, real-time power imbalances will further 
cost the retailer in the real-time market. Therefore, minimizing 
the real-time market cost directly achieves the goal of real-time 
power balancing in the grid. 

The scenario under consideration is that the retailer will 
inform the customers the dynamic price, and the HEMS in 
each individual residence will optimize their electricity cost 
by scheduling its appliance activities according to the price. 
To encourage the customers to join the proposed coordinated 
HEMS program, we assume that the customers won't pay 
additional money compared to the cost they optimized using 
the individual HEMS. Moreover, the degree of comfort of 
customers (e.g., appliance scheduling deadline) will be taken 
into account in the coordinated HEMS architecture. Under 
such conditions, the retailer will directly benefit from the co- 
ordinated HEMS architecture while the customers will sustain 
no loss neither financially nor in their degree of comfort. 

Different from [12] and [13], the current work assumes that 
the times for which the customer may submit a request for 
an appliance are random. Moreover, given the load profiles of 
appliances, we optimally defer their operating times so as to 
minimize the real-time market cost of the retailer Such de- 
ferrable appliances include Plug-in (Hybrid) Electric Vehicles 
(PHEV), dish washer etc. which usually have higher impact on 
the grid power balancing. We show that the HEMS and pro- 
posed coordinated HEMS design problem can be formulated as 
a dynamic programming (DP). The approximate DP approach 
known as certainty equivalent control (CEC) [14] is used to ef- 
ficiently handle the considered design problems. Furthermore, 
the convex optimization based dual decomposition technique 
[15] is applied for developing a distributed implementation 
algorithm for the proposed coordinated HEMS. Simulation 
results are presented to demonstrate the effectiveness of the 
coordinated HEMS architecture. 

II. System Model and HEMS 

We consider a general wholesale market scenario where 
the retailer bids to purchase electricity from the market and 



serves a number of residential units. Each residence runs an 
energy management program for minimizing its electricity 
cost. This section presents the residential appliance load model 
and mathematical formulation of HEMS. 

A. Appliance Load Model 

Consider appliances in each residence that are control- 
lable by the HEMS; for example, the PHEV, dish washer, 
washing machine, and cloth dryer etc., that are flexible in their 
operating time and allow the HEMS to defer their schedule 
within the deadline specified by the customers. The load 
profiles of the controllable appliances are known and, once the 
appliances are ON, their operation cannot be interrupted. Our 
interest on deferrable appliances is mainly because the power 
consumption of deferrable appliances, especially PHEV, has a 
higher impact on gird stability. To model the deferrable load, 
we adopt the signal model presented in [16], which, as will 
be seen later, can greatly simplify the appliance scheduling 
optimization problems encountered in HEMS and the proposed 
coordinated HEMS. 

Let gi{i), a = l,...,Gi, denote the discrete-time load 
profile'^ of appliance i where Gi > is the maximum duration 
of gi{£), for i — 1, . . . ,N. Assuming that the customer sends 
requests for appliance i at time ii.i, ti,2, • ■ • <= {^,---,L}, 
where L > denotes the maximum time horizon. Then, if 
without scheduling, the load injection due to appliance i is 
given by 

oo 

D,{i)=J29^{i~U.k), e=l,...,L. (1) 

fc=l 

One can describe the requests for appliance i as a request 
arrival process: 

a,(£) = ^w(£-t,,fe), £=1,...,L, (2) 

k=l 

where u{t) is the unit step function-'. To model the customer's 
behavior in using appliance i, we assume that the arrival 
process ai{£) is a non-stationary random process with the 
average number of new arrivals at time £ being e [0, 1], 
i.e., K{ai(£) — ai{£ — 1)} = a(. For example, one may model 
ai{£) — ai{£ — 1) as a binary random variable with being 
the probability that appliance i will be requested at time £. 

The requested tasks of controllable appliances may be 
queued and scheduled to be ON later depending on the control 
of HEMS. Suppose that s^^i, Si,2, ■ ■ ■ G {1, . . . , L}, are the 
scheduled operating times of appliance i, where > t^ fe 
for all k. Then the scheduled load injection of appliance i is 
given by 

oo 

S,{£) = Y,g^{£-s,.u), £ = !,..., L. (3) 

fc=i 

'In this paper, for simplicity, we will assume only active power and ignore 
the reactive power of each appliance. If necessary, the reactive power can be 
easily incorporated into the developed algorithms in the subsequent sections. 

^-gi{t) = for £ < 1 and £ > Gi. 

^u{t) is equal to one for t > and zero otherwise 



Similarly, the operating times of appliance i can also be 
described by a task departure (launching) process as 



(4) 



fe=i 



The total load injection of a residence is the summation 
of the controllable load and uncontrollable load (e.g., lights, 
stove etc.), and can be expressed as 



N 



(5) 



i=i 



where U{£) is the load of the uncontrollable appliances. 
B. HEMS 

Given the dynamic electricity prices from the retailer, de- 
noted by p{£), £ = 1, . . . , L, HEMS targets to schedule the 
controllable appliances such that the average total electricity 
cost of the residence, i.e.. 



^E{p(£)Aotal(^)} 



(6) 



can be minimized. The scheduling task is usually subject to 
a constraint that reflects the customer's degree of comfort. 
Here we assume that the customer will preassign a maximum 
tolerable delay for each appliance, and the HEMS has to turn 
on the appliance before the specified deadline. In particular, 
we denote Ci > as the maximum delay time of appliance i. 
Then the operating times of appliance i have to satisfy 



(7) 



for all k, in order to fulfill the degree of comfort of the 
customer. 

Mathematically, the HEMS design problem can be for- 
mulated as the following multi-stage stochastic optimization 
problem 



mm 

Si, 1, Si, 2, 



L ( / N N 

J2E\p{£)lY,Sdi) 

i=l I \i=l / 



subject to (s.t.) 5,(£) 



E 

fc=i 



gi{t - SiM) V i,£, 



(8a) 



(8b) 



ti,k < Si^k < U,k + Ci\/ i, k, (8c) 

(8d) 



Si^k < L\/ i,k, 

N 



i=l 



S,{£) < Pmax V £. 



(8e) 



where (8d) implies that all the appliances have to be scheduled 
before the horizon L, and Pmax in (8e) denotes the max- 
imum power flow constraints of the residence. As will be 
detailed later, problem (8) can be formulated as a dynamic 
programming (DP) problem and can be efficiently handled by 
approximate DP techniques [14] 

While the dynamic prices {p{£)}^^i are designed by the 
retailer such that the customers would move their load to 



the off-peak period of the power grid, as pointed out in 
[11], the HEMS individually operated by each residence may 
create a new "rebound" peak in the low-price period that 
can be even more severe than that without HEMS. As a 
result, the aggregate load injection from multiple HEMS- 
based residential units will not necessarily follow the energy 
supply scheduled by the day-ahead market, and the resultant 
real-time power balancing would increase the cost of the 
retailer in the wholesale real-time bidding market. In the next 
section, we propose to coordinate the energy management 
of multiple residences, aiming at minimizing the wholesale 
real-time market cost of the retailer The benefits of such a 
coordinated energy management architecture, which we refer 
to as coordinated HEMS, will be demonstrated via computer 
simulations. 

III. Coordinated HEMS 

We first analyze the costs of the retailer and the incentives 
to the customers so that the customers would like to join the 
proposed coordinated HEMS program. The mathematical for- 
mulation of the proposed coordinated HEMS will be presented 
in the second subsection. The third subsection shows how the 
coordinated HEMS design problem can be recast as a standard 
DP and can be handled by the approximate DP technique 
known as certainty equivalent control (CEC) [14]. 

A. Cost of Retailer and Incentives to Customers 

The cost of the retailer mainly consists of two parts, 
namely, the wholesale day-ahead market bidding cost and the 
wholesale real-time market bidding cost. In the day-ahead 
market, the retailer bids to purchase energy from the generator 
through ISO according to the predicted load requirement for 
the upcoming day. Due to the prediction errors, the load 
actually consumed in real time may deviate from the scheduled 
energy supply. Under such circumstances, the retailer has to 
purchase additional amount of energy in the real-time market 
or pay to the grid for absorbing the extra energy that cannot be 
consumed, in order to maintain the real-time power balancing. 
Let 7rp(£) be the price for buying energy from the real-time 
market and 'Ks{£) be the price for absorbing extra energy (if 
T^s{£) < then it implies that the retailer may sell back 
the extra energy). Let E{£) be the energy supply. Moreover, 
assume that there are totally M residential units, each of which 
contributes i'l^ai (^^^ (5)) 1°^^^ injection to the system. The 
total real-time market cost of the retailer is given by 



CoStflT = ^ 



M 



^s{£)[Ei£)-J2D[:ilie)\ 

\ m=l J 

/ M N 



(9) 

where (a;)+ = max{a;, 0}. The profit of the retailer can be 
roughly calculated as 



Profit = Be — Costi^T — Co&Ida 



(10) 



where Be represents the total money paid by the customers 
for their electricity usage (by (6), each customer will pay 
X^fci -P(^)^totai(^)), and Cost£)yii denotes the cost for day- 
ahead market. As discussed in the previous section, the HEMS 
ran in each residential unit will not only reduce the bill but 
also potentially increase the real-time market cost Cost^jx of 
the retailer Hence it is desirable for the retailer to coordinate 
the HEMS of the residential units to reduce Cost/?T- 

As incentives for the customers to participate in the co- 
ordinated HEMS program, we propose that 1) the retailer 
will charge the same amount of money from the customers 
as that optimized by their individual HEMS (i.e., (8)); 2) 
the coordinated HEMS will maintain the same scheduling 
deadline constraints specified by the customers. In summary, 
the customers would neither have any financial loss nor would 
lose any degree of comfort, if they joined the coordinated 
HEMS program. Nevertheless, the retailer will directly benefit 
from the reduction of CosIrt according to (10). 

B. Proposed Coordinated HEMS 

Following the two conditions above, we propose to coordi- 
nate the scheduling tasks of the M residential units, targeting 
at minimizing the real-time market cost in (9). To extend 
the load models in Section II-A to the AI residential units, 
we use superscript (rn) to denote the mth residential unit; 
for example, t^™-* and s^™-* represent the request arrival and 
task operating times of appliance i in the mth residence, and 
s'f^^i) represents the controllable load injection of appliance 
i in the mth residence. 

The proposed coordinated HEMS design is given by 

X + 



mm 



1=1 



Mi) m) 



M 

E 



(m) 
total 




N 



s.t. Di:l{e)^u^^-\£) + Y^sl"'\e), 



(lla) 
(lib) 



i=l 



s'f^^)y i,e,m, (lie) 



,(m) 

'i,k 



k=l 



(m) 



^~,k ^ *i,fc - ''i.k "1" Si 



< L \f i,k,m, 

N 

1=1 



V i, k, m, 



(lid) 
(lie) 

(llf) 



Problem (11) minimizes the average real-time market cost of 
the retailer Note that problem (11) is subject to the same 
scheduling constraints as problem (8) for each residential unit, 
meaning that the degree of comfort of customers is preserved 
in the proposed coordinated HEMS. 

We show here that the coordinated HEMS problem (11) 
can be expressed as a DP. The key observation is that finding 



the optimal operating times s\i , 2 ' ■•■ equivalent to 
finding the optimal task departure (launching) process d["^^ {£). 
Specifically, in accordance with (4), the optimal s'™'' is given 
by £* if £* is the minimum number in the set 

£^'\k)^{ie{l,...,L}\d'r\e) = k}. 

We should emphasize here that the observation above can 
significantly simplify the optimization of (11). 

By the fact that the load injection in (3) is the convolution 
of the departure process difference d'f^\£) — d'f^\£ — 1) and 
the load profile gl"^\i), one can express sl™'\£) in (11c) as 



J2ldri^-k + l)-4''\e^k)]gt\k) 



fe=i 

min{f,G*"*'} 



= E [d^"\e~k + i)-dt\e-k)]gl'-Hk), 

(12) 



fe=i 



where d'f^\o) = 0, and the second equality is owing to 



that gl"''\£) has a maximum duration . Moreover, since 
d["^\£) is nondecreasing and according to the scheduling 
constraints (lid) and (lie), d^f^^i) should satisfy 



(m) 



dr\e)<ar 




(13a) 


dt\e), 




(13b) 


dt\L):^at 




(13c) 






(13d) 



for all £, i and m, where Z+ denotes the set of nonnegative 
integers. Specifically, (13b) guarantees that appliance i will be 
scheduled within the maximum delay (^^'^ . 

By (12) and (13), we can reformulate problem (11) as the 
following problem 

r / M N \ + 



lin Ve 



N 



\£) 



rn — 1 i—1 
M N 



\'ni—l i—1 



s.t. ^^i")^ <P„,ax V^,m, 



i=l 



constraints in (12) — (13), 



(14a) 

(14b) 
(14c) 



where E{£) = E{£) - Y.Z=i U'^"'H^) (see (5)). Comparing 
with (11), in (14), the optimal departure processes {d["^\£)} 
are to be determined instead. 

Problem (14) can be solved by the standard DP approach, 
e.g., using the principle of optimality of DP [14], by which 
the optimal control policy for {d[™'\£)} can be obtained in a 
backward search manner. This method, however, is not com- 
putationally feasible because (14) involves a large dimension 



of state vector. In particular, the state vector corresponding to 
(14) at stage £ is given by 



X, - [xl,{l), . . . , xl^{e), xl,, . . . , xl^^{£)f, (15) 
where 

a'r\i),a^\e-Cl"'^)f. (16) 

As seen, the number of possibilities of x^ exponentially 
increase with M and N. 

C. Certainty Equivalent Control ( CEC) 

Certainty Equivalent Control (CEC) is a simple approach 
to obtaining an approximate solution of a complicated DP 
problem [14]. In CEC, we search the optimal control in a 
forward manner and apply the control at each time that would 
be optimal if the uncertainty quantities were fixed at the typical 
values, e.g., the mean value. Therefore, by CEC, we can 
obtain an approximate solution to (14) in an on-line fashion, 
sequentially from time 1 to L, and each time we only need 
to deal with a deterministic optimization problem. Applying 
CEC to problem (14), we obtain the following algorithm: 

Algorithm 1 CEC approach to problem (14) 

1: for time £ = 1, . . . ,L — 1 do 

2: Given x^, solve the following problem 



E 



\ m — 1 i—l 

/ JM N \ ^ 

\m=l i = l ) 



(17) 



S.t. ^Si'"'(£) <Pn,ax, 
1=1 

d^r\£ - 1) < dt\£) < a^\i) + a'r\k) 



(m) / 



Am) 



Am) 



k=l + l 



{£) GZ+, y ■m,i,£ = e,...,L, 



and denote {d^"^\£)}i.m,i as the associated optimal solu- 
tion. 

3: Set d!f^\£) = d!f^\£) for all i,m, as the approximate 

solution at time £. 
4: end for 



In (17), S'f"'(€) is given by (12), and ^Y'"'{£) is defined as 



(m) , 



£^£,...,£ + C, 



i^) ^t' (k), elsewhere. 



Note that, in (17), the unknown arrivals a^\£), £ = £ + 
1, . . . ,i, at time £ are set to their mean values a^f^\£) + 

X]fc=£+i o^i^'l^'): = ^+ so problem (17) is a 

deterministic optimization problem for all £ ~ 1, . . . ,L. 

Problem (17) has a convex objective function and convex 
constraints, except for the integer constraints S^^\£) G Z+. 
Since the integer constraints lead to a discrete optimization 
problem which is difficult to handle in general, we simply relax 
the integer constraints to nonnegative orthant (i|™''(£) > 0. 
An approximate solution to (17) can be obtained by rounding 
the solutions of the relaxed problem into the nearest integers. 
Next we show that the relaxed counterpart of problem (17) 
can be recast as a linear programming (LP) which thus can be 
solved efficiently. To illustrate this, let us first express (17) in 
a compact form. Define 

7rp=[7rp(L),...,7rp(€)]^, 

TT, =[lT,{L),...,^,(t)f, 

^^[E{L),...,E{£)f, 



min{AGi")}), 
4")(L),...,d(,™)(£"-min{£-,G(r)})] 

*(™) =[n('"\ . . . , f2(7)]blkdiag{T(™', . . . , tJ^)}, 



where e 



(L-i+l) X (L-£+min{f ,G*"*' }) 



is a Toeplitz 

matrix with the first row given by . . . , (7j-'"''(g|™'')] 



and the first column given by 0, . . . , 0]^ , and 

blkdiaglT^™'', . . . , T^^''*} is a block diagonal matrix in 

which T^™^ G ]^(L-Z+min{Z,G<"'})x(L-f+min{Z,G<'"'} + l) jg ^ 

Toeplitz matrix with the first row being [1, — 1, 0, . . . , 0] and 
the first column being [1, 0, . . . , 0]^. Moreover, define 

d(")(£ - 1) < Sr\£) < at\i) + Ei=l+i o.^\kl 

d^^ (L) = a|™' {£) + (fc) V ^, £ = . . . , 

where ^ and >^ denote the element-wise inequalities, and 1 
(0) is the all-one (all-zero) vector. Then problem (17) can be 
expressed as 

min ttJ ^("^df™)'] 

rn=l,...,M \ ™=1 / 

S.t. d*™) GiY*"', m=l,...,M. 
By introducing a slack variable 



\rn=l J 



(18) 
(19) 

(20) 



one can write 



V m=l / \m=l / 

Substituting the above equations into (18) gives rise to 



L 

f 1 



Assume the usual case of tt^ + TTp ^ 0. Then the constraint 
(21a) can be shown to be equivalent to the following two linear 
constrains: 

M 
rn—l 

By replacing (21a) with (22), we end up with the following 
LP representation for (17): 



(7r, + 7rp)^^-7rf (^f;*MJ(™)_E^ 



S.t. 2^0, 

M 

ztYl ^'"''i*'"^ - E, 

m— 1 



(23a) 
(23b) 



As a remark, we should mention that the reformulation idea 
in Section 111-B and the CEC method in Section 111-C can also 
be applied for handling the individual HEMS problem in (8). 

IV. Distributed Implementation 

In the previous section, we have shown how the proposed 
coordinated HEMS problem (11) can be approximated by CEC 
which involves only solving the integer-constraint-relaxed LP 
problem (23). To solve problem (23), a centralized control 
is needed in general. The control center not only knows 
the appliance profiles in each residential units, but also the 
statistical and real-time information of the request arrival 
processes {a["^\£)}. In view of the fact that the computa- 
tional complexity of solving (23) increases with the number 
of residences and the number of controllable appliances, a 
decentralized implementation algorithm, that can decompose 
the original problem into parallel subproblems with smaller 
problem size, is of great interest. In particular, we are in- 
terested in decentralized algorithms that allow each of the 
residential units to compute its scheduling solution locally 
using only domestic information so that the customers' privacy 
on electricity usage can also be preserved. 



In this section, we present a decentralized implementation 
method for problem (23), using the convex optimization 
based dual decomposition method [15]. Combining such a 
decentralized method with Algorithm 1, a simple distributed 
coordinated HEMS algorithm is obtained. 

As its name suggests, dual decomposition solves the prob- 
lem in the Lagrangian dual domain. Let fi h and A ^ be 
the dual variables associated with the inequality constraints 
in (23a) and (23b), respectively. By definition [17], the La- 
grangian dual problem of (23) can be shown to be 



max 

At^O,A>:0 



(m,a) 



(24) 



where ^(/x, A) is the dual function given by 

/ M 



mm (tTs + TVpfz - tt J V - E 

Vm, ' 



\m—l 



M 



mm 



-oo, elsewhere. 



\m=l 



\m—l 



if TTp + TTs - A = /.t, 



Substituting the above equation into (24) gives rise to 



M 



mm (A - TVsf V - E 

max < w_ ' ' \ ^-^ 

s.t. eW("\ m = 1,...,A/. 

(25) 

Since problem (23) is convex and satisfies Slater's condition 
[17], the dual problem (25) attains the same optimal objective 
value as (23). One can see from (25) that the inner part is 
decomposible, and can be solved in a parallel fashion given 
A. Therefore, a decentralized implementation can be obtained 
by solving the dual problem (25). Specifically, we can use 
the projected subgradient method [18] to deal with (25) in an 
iterative manner In iteration n, given A(7i), the corresponding 
inner part of (25) can be handled by solving: 

d(")(?7, + 1) = arg min {\{n) - 7r,)^*(")d(™\ 

(26) 

for 771 = 1, . . . , M. The dual variable A can be updated using 
the standard subgradient step [18], i.e., 

(27) 

where c„ > denotes the step size, and denotes the 
operation of projection onto the set [0, TTp+TTg]. Equations (27) 
and (26) are iterated until convergence or the preset stopping 
criterion is satisfied. The dual decomposition method for (23) 
is summarized in Algorithm 2. Suppose that the algorithm 



Algorithm 2 Dual decomposition for problem (23) 

1: Input an initial value of A(0). 
2: Set n = 
3: repeat 

4: for 771 = 1, . . . ,M do 

5: Residence m solves (26) to obtain the solution 
-|_ 1)^ and sends it to the control center 

6: end for 

7: Given d'^'"'(n + 1), m = 1, . . . , M, the control center 
updates the dual variable A by (27), and broadcasts it 
to the residences. 

8: n = n + 1 

9: until the predefined stopping criterion is met. 



stops at iteration n*. Instead of using as the primal 

solution, we use the running-averaged version: 



1 ^ 

9=1 



d('")(g), m= 1,...,M. 



(28) 



It is shown [19] that this averaged version d'™) is more 
numerically stable than d'™-'(7i*), especially for our problem 
(23) which is not strictly convex. 

In Algorithm 2, we assume that there is a control center 
which collects S"^\n + 1) from the residences and uses 
the information for updating the dual variable A (Step 7). 
If there is no control center present, the residences can still 
perform subgradient update (27) individually by obtaining 
the aggregate load profile X]m=i + 1)) ™ ^ 

fully distributed fashion, e.g., using the average consensus 
algorithms or gossip algorithms [20], [21]. 

V. Simulation Results 

In this section, some simulation results are presented to 
examine the effectiveness of the proposed coordinated HEMS. 
We consider a scenario where there are 60 residential units 
(M = 60), with 3 controllable appliances in each residence 
(N = 3). The optimization horizon is set to 96 (L = 96) which 
is obtained by considering a whole day with 24 hours and 4 
quarters for each hour (starting from 8 pm to the next day). 
The three appliances are assumed to have rectangular power 
profiles, with instantaneous energy consumptions uniformly 
generated between [0.8,1.9] (kWh) (e.g., PHEV), [0.3,0.5] 
(e.g., dish washer) and [0.8, 1.2] (e.g., cloth dryer), respec- 
tively (reference from http://www.absak.com/library/power- 
consumption-table). The simulation setting of {g[ } and 
{Ci™"*} ^re detailed in Table 1. We assume that each residence 
will send a request for Appliance 1 with probability 0.8 in a 
time uniformly distributed between 8 pm and midnight, and 
with probability 0.3 in a time uniformly distributed between 8 
am and 12 pm. Appliance 2 is set to probability 0.8 in three 
times that are uniformly distributed between 6 am and 10 am, 
12 pm and 2 pm, and 5 pm and 7 pm, respectively. Appliance 
3 is set to probabilities 0.8 and 1 in the times between 2 pm 
and 3 pm, and 8 pm and 10 pm, respectively. 



TABLE I: Simulation Setting of Appliances. The notion U ■ 
[a, b] stands for a uniform distribution in the interval [a,b]. 





Appliance 1 


Appliance 2 


Appliance 3 


gf-ii) (kWh) 


V ~ [3.25,7.5] 


V ~ [1.2,1.5] 


U ~ [0.3,0.5] 


g('"' (quarter) 


V ~ [16,32] 


U ~ [2, 4] 


U ~ [4, 12] 


fl™' (quarter) 


V ~ [4, 16] 


U ~ [4, 12] 


U ~ [4, 12] 



0.035 




O.OISt 



8 pm 



1 am 



6 am 11 am 
Time 



4 pm 



Fig. 1: Day ahead price obtained from 
https ://w w w2 . ameren.com/RetailEnergy/realtimeprices . aspx, 
on day Nov. 15, 2001. 

For HEIVIS in (8), we use the day-ahead price as shown 
in Figure 1. For the proposed coordinated HEIVIS in (11), 
we consider two examples. In the first example, we set 
TTp = TTs = 1, by which the objective value of (11) reduces 

to Etiim - E™=iA^:lWI- We use this setting to 
examine the deviation between the scheduled load and the 
energy supply. In the second example, we set = 1 and 
TTg = —0.51, simulating the scenario that the retailer is able 
to sell the extra electricity back to the grid. In the simulations, 
for simplicity, we assume that, in each residence, the uncon- 
trollable appliances contribute a constant instantaneous energy 
consumption of 5 kWh, which is assumed to be known by the 
residence in advance by prediction. 

Example 1: Figure 2 shows the simulation results for a ran- 
domly generated problem instance with TTp = tTs = 1. Firstly, 
one can see from this figure and Figure 1 that the HEMS 
(i.e., (8)) successfully move the load to the lower price region, 
but that causes significant power imbalance. Specifically, the 



deviation Yle=i l-E'(^) - J2m=i^totLi\ corresponding to the 
unscheduled load is 1494, but the deviation corresponding 
to individual HEMS increases to 2450. Secondly, we can 
see from Figure 2 that the proposed coordinated HEMS can 
schedule the load such that the corresponding load follows the 
energy supply. The load deviation of the proposed coordinated 
HEMS dramatically decreases to 698. Thirdly, we can observe 
that the distributed coordinated HEMS can yield almost the 
same performance as its centralized counterpart. 

Example 2: Figure 3 shows the simulation results for 
another randomly generated problem instance with TTp = 1 
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Fig. 2: Simulation results for a randomly generated problem 



instance with TTp = tTs = 1. 
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Fig. 3: Simulation results for a randomly generated problem 
instance with TTp = 1 and tTs = —0.51. 



and TTs ~ —0.51. The simulation results are similar to Figure 
2. In this case, the real-time cost in (9) corresponding to the 
unscheduled load is 139 and that corresponding to HEMS is 
276. The proposed coordinated HEMS however can reduce 
the cost to -246. This demonstrates well the efficacy of the 
proposed coordinated HEMS. 

VI. Conclusions 

In the paper, we have presented a coordinated HEMS 
architecture that coordinates the home energy scheduling of 
multiple residential units in order to reduce the real-time 
market cost of the retailer We have shown that the coordinated 
HEMS design problem can be reformulated as a DP which 
can be efficiently handled by CEC. Moreover, a distributed 
implementation method by dual decomposition is also pro- 
posed. The presented Simulation results have shown that the 



proposed coordinated HEMS can effectively achieve real-time 
power balancing in contrast to the individual HEMS that may 
cause a rebound peak load in the low-price region. 
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